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1.  INTRODUCTION 


We  wish  to  approximate  Sf  where  S is  a linear  operator  and  f belongs 
to  a set  3q*  Assume  we  are  given  Utf  where  91  is  a finite  dimensional  linear 
operator.  We  say  91  is  an  information  operator  and  that  91f  is  the  information 
on  f.  We  approximate  Sf  by  cp(9lf)  where  cp  is  an  operator  which  is  called  an 
algorithm. 

There  are  many  papers  dealing  with  optimal  algorithms,  i.e.,  algorithms 
cp  for  which  the  global  error  e (cp)  = sup{||  Sf-cp(9tf)  ||  : f 6 3q)  is  minimized. 
The  optimal  algorithms  produce  the  best  possible  approximations  for  "worst" 
elements  f.  By  a worst  f we  mean  that  [|  Sf-cp(9tf)  ||  * e(cp).  However  it  may 
happen  that  an  optimal  algorithm  cp  does  not  produce  a best  possible  approxi- 
mation for  "easy"  elements  f.  (By  an  easy  f we  mean  ||  Sf-cp(9lf)  ||  « e(cp).) 

For  the  user  who  may  want  to  solve  the  problem  for  just  such  an  easy  f this 
is  a very  undesirable  property.  Therefore  in  this  paper  we  study  algorithms 
which  are  not  only  optimal  (or  nearly  optimal)  but  for  which  the  local  error 
||  Sf-cp(9lf)  ||  is  almost  as  small  as  possible  for  every  f from  3g* 

The  algorithms  which  have  the  smallest  possible  local  error  for  every  f 
are  called  central  and  were  introduced  by  Traub  and  Wozniakowski  [77],  We 
introduce  the  concept  of  deviation  dev(cp)  of  an  algorithm  cp.  This  is  the 
ratio,  for  the  worst  case  f,  between  the  local  error  of  cp  and  the  error  of 
a central  algorithm.  Thus,  dev(cp)  6 [1,+®].  We  are  interested  in  algorithms 
with  small  deviation. 

In  general,  optimal  algorithms  have  large  combinatory  complexity,  i.e., 
the  computation  of  cp(y)  given  y ■ 9tf  requires  much  more  work  than  the  compu- 
tation of  9tf.  There  exists  a class  of  algorithms  with  small  combinatory 
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complexity.  This  is  the  class  of  linear  algorithms  cp  (i.e.,  cp  is  a linear 
operator).  Since  we  want  to  assure  small  combinatory  complexity  we  shall 
study  linear  algorithms  in  this  paper. 

These  twin  desiderata  of  small  deviation  and  linearity  suggest  the  fol- 
lowing questions: 

(1.1)  Do  there  exist  linear  algorithms  with  small  deviation? 

(1.2)  Do  there  exist  linear  algorithms  with  small  deviation  which 
are  optimal? 

We  introduce  the  concept  of  a spline  algorithm  and  show  that  spline  algo- 
rithms permit  us  to  answer  (1.1)  and  (1.2). 

Splines  are  extensively  used  in  numerical  mathematics  and  in  the  theory 
of  approximation.  There  are  enormous  numbers  of  papers  dealing  with  many 
theoretical  and  practical  aspects  of  sp lines.  Many  optimal  properties  of 
splines  are  known.  Probably  Schoenberg  [64a]  was  the  first  one  who  realized 
the  close  connection  between  splines  and  optimal  algorithms  in  the  sense  of 
Sard. 

Splines  were  used  to  establish  optimal  algorithms  (sometimes  in  the 
sense  of  Sard)  for  many  problems.  For  instance,  see  Coman  [72],  Karlin  [71], 
Kornejcuk  and  Luspaj  [63],  Kornejcuk  [74],  Lee  [77],  Ligun  [76],  Lipow  [73], 
Schoenberg  [64b,  65,  69,  70]  and  Secrest  [65b]  who  considered  the  integra- 
tion problem,  Bojanov  [75],  Forst  [77],  Gaffney  and  Powell  [76],  Gaffney  [77a, 
77b]  who  considered  the  interpolation  problem,  de  Boor  [77],  Golomb  [77], 
Melkman  [77],  Micchelli,  Rivlin  and  Winograd  [76],  Micchelli  and  Pinkus  [77] 
who  considered  the  approximation  problem,  Ahlberg  and  Nilson  [66],  Mangasarian 
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and  Schumaker  [73],  Mansfield  [72],  Nielson  [73],  Reinsch  [74],  Ritter  [70], 


Schoenberg  [64a]  and  Secrest  [65a]  who  considered  approximation  of  linear 


functionals,  Grebennikov  and  Morozov  [77]  and  Micchelli  and  Rivlin  [77]  who 


considered  approximation  of  linear  operators,  and  Grebennikov  [78]  who  con- 


sidered approximation  of  nonlinear  operators.  Also  a classic  paper  of 


Golomb  and  Weinberger  [59]  dealing  with  approximation  of  linear  functionals 


implicitly  made  use  of  optimal  properties  of  splines. 


This  paper  unifies  and  generalizes  many  known  results  and  develops  new 


optimality  properties  of  spline  algorithms. 


We  summarize  the  results  of  the  paper.  In  Section  2 we  briefly  state 


the  problem,  the  notation,  and  fundamental  known  results.  We  introduce  the 


concept  of  deviation  which  plays  a fundamental  role  in  the  paper.  In  Sec- 


tion 3 we  recall  the  definition  of  splines  in  a linear  normed  space.  We 


give  a general  definition  of  a spline  algorithm  in  Section  4.  Spline  algo- 


rithms are  homogenous  and  not  necessarily  linear.  We  prove  their  deviation 


is  no  greater  than  two.  Assuming  the  uniqueness  of  the  spline  algorithm  we 


prove  that  any  linear  (in  fact,  even  any  homogenous)  non-spline  algorithm  has 


infinite  deviation.  This  yields  the  answer  to  (1.1).  Namely,  the  class  of 


linear  algorithms  with  finite  deviation  consists  only  of  linear  spline  algo- 


rithms. So,  this  class  is  empty  iff  spline  algorithms  are  nonlinear.  In 


Section  5 we  specialize  to  spline  algorithms  in  a Hilbert  case.  We  show  that 


then  the  spline  algorithm  is  linear  and  central.  This  means  that  its  devia- 


tion is  equal  to  unity  and  its  combinatory  complexity  is  proportional  to  the 


"amount"  of  information.  Section  6 returns  to  the  general  case.  We  give 


necessary  and  sufficient  conditions  for  a spline  algorithm  to  be  central  or 
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optimal.  This  answers  (1.2).  We  illustrate  the  analysis  by  several  examples 
which  shows  the  sharpness  of  our  lemmas  and  theorems.  In  Section  7 we  briefly 
discuss  a relation  between  the  Kolmogorov  n-width  and  the  radius  of  informa- 
tion. Section  8 contains  a summary  of  the  paper. 

This  paper  is  closely  related  to  Traub  and  Wozniakowski  [77],  Although 
we  define  all  concepts  required  here,  it  would  probably  be  helpful  to  the 
reader  to  be  familiar  with  the  concepts  introduced  in  that  paper. 


2.  BASIC  CONCEPTS  AND  DEFINITIONS 


We  recall  and  slightly  extend  the  basic  notation  and  some  results  of 
Traub  and  Wozniakowski  [77], 

Let  S and  T be  linear  operators  such  that 


(2.1) 


S:  - V 

T:  3,.  - 


where  3^  is  a linear  space  and  2^,2^  - T(3j)  are  linear  and  normed  spaces 
over  the  real  or  complex  field.  Our  aim  is  to  approximate  an  element  a = S(f) 
for  any  f € 3g  where 

(2.2)  30  - U 6 ||  Tf  ||  s 1}. 

To  approximate  a we  assume  we  know  the  information  operator 
31(f)  = [Lx (f ), L2 (f ),..., Ln(f)]  where  are  linearly  independent 

linear  functionals.  The  number  n is  called  the  cardinality  of  the  informa- 
tion operator  31  and  is  denoted  by  n a card  (31). 

By  an  algorithm  cp  we  mean  an  operator  which  approximates  a =*  S(f)  knowing 
only  y ■ 31(f)  € (E  , i.e.,  cp:  D^  c ^ -*  32*  Note  that  cp(y)  has  to  approxi- 
mate all  elements  S(f)  for  any  f 6 3q  such  that  31(f)  * y.  Define  two  sets 

(2.3)  V(y)  - Cf  € 3o=  *(«  " y}, 

(2.4)  U(y)  - [Sf:  f € V(y) }. 


Then  an  algorithm  cp  cannot  recognize  which  element  Sf  € U(y)  is  actually 
approximated.  The  local  error  e(cp,y)  of  the  algorithm  cp  for  y € 31(3^)  is 


f€v(y) 

By  the  global  error  we  mean 


(2.6)  e(cp)  = sup  e(cp,y)  = sup  ||  cp(trt(f) )-Sf  ||  . 

y®»(30)- 

Let  9 = §(3l,S,T)  be  the  class  of  all  algorithms  which  use  the  information 
operator  31  for  the  problem  defined  by  S and  T.  Traub  and  Wozniakovski  [77] 
proved 

Theorem  2 . 1 

(2.7)  inf  e(cp,y)  = radU(y),  Vy  €51(3  ) 

(2.8)  inf  e(®)  = r(31,S,T) 

where  rad  U(y)  denotes  the  radius  of  the  set  U(y), 

(2.9)  rad  U(y)  = inf  sup  ||  x-Sf||  , 

f€v(y) 

and 

(2.10)  r(3t,S,T)  = sup  rad  u(y)  = c sup  - - 

y^l(30)  hQcer  31  Ttl 

is  called  the  radius  of  information  31  for  the  problem  S,T,  and  c is  a constant 
from  [1.2].  B 

See  also  Micchelli  and  Rivlin  [77]  where  some  related  results  may  be 


found.  We  shall  assume  that  r(3t,S,T)  < + ».  As  in  Traub  and  Woz'niakowski 
[77]  observe  that  if  ker  31  H ker  T £ ker  S then  there  exists  an  element 
h ^ ker  31  fi  ker  T,  Sh  f 0 and  Sf  + cSh  6 U(y)  for  any  y and  any  constant  c 


■■■  . 
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where  31(f)  = y and  f € 3g.  Hence  ker  31  0 ker  T £ ker  S implies 

rad  U(y)  = +«=,  Vy  6 3l(^)  . Therefore  we  shall  assume  throughout  the  paper 

that 

(2.11)  ker  31  D ker  T c ker  S 

which  is  a necessary  condition  for  r(31,S,T)  < 

From  (2.8)  it  follows  that  an  algorithm  cp  is  optimal  iff  e(cp)  =»  r(3t,S,T). 

As  we  mentioned  in  the  Introduction  we  are  primarily  interested  in  algorithms 
which  produce  a nearly  optimal  approximation  for  every  f.  Theorem  2.1  states 
that  the  radius  rad  U(y)  is  the  sharp  lower  bound  on  the  local  error  of  an  algo- 
rithm for  every  y € 31(f) . Since  we  want  to  assure  that  the  local  error  of  an  algo- 
rithm cp  is  nearly  as  small  as  possible,  we  compare  e(cp,y)  with  rad  U(y). 

This  leads  us  to  the  concept  of  deviation  defined  as  follows. 

Definition  2.1 

We  shall  say  dev(cp)  is  the  deviation  of  the  algorithm  cc,  cp  6 §(3t,S,T),  iff 


(2.12)  dev(cp)  = sup 

y63l(3o)  rad  U(y) 

Of  course,  dev(cp)  2 i 10r  any  cp. 


sup  sup  , TT , . . 

yC*(30>  fCv(y)  “d  J 


<p(y>-sf  I 


We  mention  two  classes  of  algorithms  for  which  the  deviation  is  small. 

c 

The  first  one  is  the  class  of  central  algorithms  5 defined  by  Traub  and 
Wozniakowski  [77].  An  algorithm  9 is  central  if  9(y)  is  a center  (if  it 
exists)  of  the  set  U (y) , vy  € 3l([>^) . The  center,  9(y) , is  defined  by 

(2.13)  sup  ||  x-cp(y)  ||  - rad  U(y) . 
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n 

(2.17)  cp(y)  * ^ L.(f)g.,  y - *Rrf)  - [Ll(f),L2(f) Ln(f)]f 

i=»l 

where  * gj^jS.T)  6 Since  g^.g^, .. . ,gn  are  independent  of  f,  they 

can  be  precomputed.  Knowing  g^,  we  perform  at  most  n multiplications  of  an 
element  from  ^ by  a scalar  and  (n-1)  additions  of  elements  from  ^ to  com- 
pute cp(y) . Taking  the  cost  of  one  such  multiplication  and  one  such  addition 
as  unity  and  neglecting  the  cost  of  precomputing  we  conclude 

that  the  combinatory  complexity  of  a linear  algorithm  is  at  most  2n-l. 

The  problem  of  linear  algorithms  with  small  deviation  is  closely  related 
to  spline  algorithms  which  will  be  introduced  in  Section  4.  Before  that  we 
remind  the  reader  of  the  definition  of  splines  in  a linear  normed  space. 


3.1 

3.  SPLINES 

We  remind  the  reader  of  the  definition  and  some  basic  properties  of 
splines  in  linear  normed  spaces  and  introduce  notation  we  will  use  in  this 

paper.  See  among  others  Anselone  and  Laurent  [68],  Atteia  [65]  and  Holmes 
[72]. 

Let  y € Cn.  Define 

(3.1)  A(y)  - If  6 3X:  31(f)  = y). 

Note  that  for  an,’  y,  the  set  A(y)  is  nonempty  since  31  is  defined  by  n linearly 
independent  linear  functionals,  i.e.,  31^)  = Cn.  See  Section  2. 

Definition  3.1 

An  element  O' (y)  £ A(y)  is  called  a spline  interpolating  y (briefly  a is 
a spline)  iff 

(3.2)  ||  To (y)  ||=  min  ||Tf||.  Q 

f €A(y) 

Let  z € 3^*  Define 

(3.3)  P(z)  = [h  6 ker  31:  ||  Th-z  ||  = dist(T(ker  31)  ,z)  }. 

Thus,  every  element  of  T(?(z))  is  a best  approximation  of  the  element  z from 
the  set  T(ker  31).  it  is  easy  to  observe  that  the  concepts  of  splines  and 
best  approximation  are  closely  connected.  Namely,  the  following  relations 
hold: 


(3.4)  There  exists  a spline  a (y)  interpolating  y iff  the  set  P(Tf)  is 
nonempty  for  some  f 6 A(y) . 


(3.5)  An  element  c £ A(y)  is  a spline  interpolating  y iff  t-G  6 P(Tf)  for 
every  f 6 A(y) . 

(3.6)  There  exists  a unique  spline  n(y)  iff  ker  31  H ker  T ■ [o}  and  P(Tf) 
is  a singleton  set  (i.e.,  P(Tf)  has  exactly  one  element),  Vf  €A(y). 

Splines  are  homogenous,  i.e.,  if  a(y)  is  a spline  interpolating  y,  then 
cff(y)  is  a spline  interpolating  cy  for  any  constant  c 6 C.  This  means  that 
o(cy)  = c(3,(y)  whenever  the  spline  <J(y)  is  uniquely  defined. 

Suppose  that  ^ = T(^)  is  a Hilbert  space.  Then  P(Tf)  is  nonempty  for 
any  f 6 iff  T(ker  ?t)  is  closed.  Furthermore,  C(y)  is  a spline  iff 
CT(y)  € A(y)  and  (TO’(y).Th)  * 0,  Vh  € ker  31.  A spline  o depends  linearly  on 
y,  i.e.,  if  splines  cr(y^)  and  c(y^)  interpolate  and  y^  respectively  then 

Cla^yl^  + c2a^2^  a sp^ine  interpolating  c^y^  + <^2y2  ^or  an^  constants 
c^,c9  € C.  The  splines  u(y)  are  uniquely  defined  iff  ker  31  H ker  T * {o}. 


4.1 


SPLINE  ALGORITHMS 


In  this  section  we  introduce  the  concept  of  spline  algorithms  and 
prove  their  optimality  properties  in  the  class  of  homogenous  and  inter- 
pola*  ry  algorithms.  To  assure  the  existence  of  splines  we  shall  assume 
throughout  the  rest  of  this  paper  that  P(Tf)  is  a nonempty  set  for  any 

f € Si- 


Definition  4 . 1 


We  shall  say  cp  is  a spline  algorithm,  cp  6 $s,  iff 
(4.1)  cp(y)  = sa(y),  Vy€9t(30), 


where  C7 (y)  is  a spline  interpolating  y.  I 

Note  that  a spline  algorithm  is  interpolatory  which  implies  that 
e(cp,y)  s diam  U(y)  s 2 rad  U(y),  and  dev(cp)  s 2.  Since  splines  are  homog- 
enous, it  is  obvious  that  a spline  algorithm  is  also  homogenous. 


Remark  4 . 1 


To  compute  cp(y)  given  y,  in  general  we  need  to  know  a spline  y) , i.e., 
to  solve  the  optimization  problem  (3.2).  The  complexity  of  solving  (3.2) 
can  be  high.  However  if  a spline  algorithm  is  linear,  i.e., 


cp(«<f>)  * > L.  (f)g. , then  we  need  to  compute  only  elements  g1fg»,...tg  • 

‘-jii  I l n 
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Since  the  elements  g1»g2>***»8n  are  independent  of  31(f),  the  idea  of  pre- 
computing  can  be  used.  This  means  that  in  many  cases  we  have  to  solve  the 
optimization  problem  (3.2)  only  once.  For  nonlinear  spline  algorithms  the 
idea  of  precomputing  cannot  in  general  be  used  and  the  combinatory  complexity 
of  such  algorithms  can  be  very  high.  ■ 


. ' ... 

L 


— >-  ■ 
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We  establish  the  optimality  properties  of  spline  algorithms  in  the 
class  ? 3 8(3l,S,  T)  . 


Lemma  4 . 1 

Let  cp, cp  € $,  be  a homogenous  algorithm  and  y 6 ^(3g)  • If  e(cp)  < +®  and 
u(y)  6 ker  T then 

(4.2)  cp(y)  = S a(y) . q 

Proof 

Since  <j(y)  € ker  T then  cs(y)  € 3g  for  any  c € (£,  and  31(c<7(y))  = cy. 
Consider  cp(cy)-S(ca(y))  3 c(cp(y)-sa(y) ) . observe  that  |c|  ||  cp(y) -Sa(y)  ||  * 
(cp)  < +“,  Vc  € I.  This  implies  cp(y)  = So-(y)  which  proves  (4.2).  B 

emma  4 .2 

Let  cp,cp  € $,  be  a homogenous  algorithm  which  is  interpolator^  . 

Then  cp  is  a spline  algorithm.  B 


Proof 

Since  cp  is  interpolatory  then  e(cp)  ^ 2r(2t,S,T)  < +®.  Take  an 
arbitrary  y from  31(3Q)  and  consider  a spline  cr(y) . if  a(y)  € ker  T then 
Lemma  4.1  yields  cp(y)  >*  Sa(y).  Thus  we  can  assume  that  Ttf(y)  f 0.  Let 
y “ y/ 1|  Ta(y)  ||  and  c(y)  be  a spline  which  interpolates  y.  Note  that 
||  To(y)||-  1 which  implies  that  a(y)  6 ^ and  31(cr(y))  = y.  Consider  the 
set  V(y)  “ if  6 2^=  *(f)  ° y»  ||  Tf  ||  * l).  Since  cj(y)  € V(y)  and 
1 3 ||  Tcr(y)  ||  £ ||  Tf  ||  for  any  f 6 V(y) , every  element  of  V(y)  is  a spline 
interpolating  y. 


i 
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The  algorithm  cp  is  interpolatory . Thus  cp(y)  6 U(y)  = SV(y)  which  means 
that  co(y)  = So(y)  for  a spline  a(y)  . Since  cp  is  also  homogenous, 
cp(y)  = ||  To(y)  ||  cp(y)  = ||  Ta(y)  ||  Sa(y)  = Sa(y)  where  a(y)  is  a spline  which 
interpolates  y.  This  proves  that  cp  is  a spline  algorithm.  □ 

We  wish  to  examine  when  there  exists  a unique  spline  algorithm.  It  is 
easy  to  prove  the  following  lemma. 

Lemma  4.3 

There  exists  a unique  spline  algorithm  iff  SP(Tf)  is  a singleton  set 
for  any  f € 3Q. 

Proof 

Let  f € 3q  and  y = 31(f).  Consider  the  splines  a^(y)  and  <J  (y)  . From 
Section  3 we  know  that  f-o^Cy)  =*  iu  6 P(Tf)  for  i » 1,2.  Then 

SCT1(y)-Sa2(y)  » Sh2-Sh1. 

Thus  SP(Tf)  is  singleton  iff  Sc^y)  = Sc2(y),  Vy  € 3g)  • This  proves 

Lemma  4.3.  Q 

We  are  ready  to  consider  the  deviation  of  homogenous  algorithms  belonging 

to  $. 

Theorem  4 . 1 

Let  SP(Tf)  be  a singleton  set  for  any  f 6 3g-  Let  cp,cp  € $,  be  a homog- 
enous algorithm.  Then 

J s 2 if  cp  is  a spline  algorithm, 

(4.3)  dev  (cp)  - ( 

1 +®  otherwise. 
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Proof 

The  inequality  dev(cp)  ^ 2 for  a spline  algorithm  cp  was  already  proven. 
If  e(cp)  = +=  then  dev(cp)  * +®  since  rad  U(y)  s r(Ul,S,T)  < +“.  Thus  with- 
out loss  of  generality  we  can  assume  cp  is  a nonspline  algorithm  with 
e(cp)  < +“.  This  means  there  exists  y € ^(3q)  such  that  cp(y)  / sa(y)  where 
o(y)  is  the  unique  spline  interpolating  y.  Lemma  4.1  guarantees  that 
Tci(y)  f 0.  As  in  the  proof  of  Lemma  4.2  define  y * y/||  TO(y)  ||  and  consider 
the  singleton  set  U(y)  3 iso(y)  ).  Of  course,  rad  U (y)  = 0.  Since  cp  is 
homogenous , 

9(y)  = 9(y)/||  Ta(y)  ||  / Sa (y)/ 1|  Ta(y)  ||  = Sa(y) . 

Thus  e(cp,y)  ^ 0 and  dev(cp)  2 e(cp,y)/rad  U(y)  = +“.  This  completes  the 
proof.  □ 

The  assumption  that  SP(Tf)  is  singleton  for  any  f € 3q  is  essential. 

To  see  that  consider  the  following  example. 


■ 


Example  4.1 

Let  ^ = 32“^“  ([[0,1]  be  the  class  of  continuous  functions  on  [0,1] 

with  the  sup  norm  ||  f ||  ■ max  |f(x)|.  Let  S ■ T ■ I be  the  identity  operator 

O^xSl 

and  y * 31(f)  * [ f (x^)  ,f  (x^) , . . . , f (xn)  ] for  some  distinct  points  x^  € [0,1], 
Thus  we  want  to  recover  the  function  f knowing  its  n values  at  x^  and  the 
bound  ||  f ||  £ 1.  It  is  easy  to  show  that 

rad  U(y)  - 1,  Vy  € 3l(3Q)  - [-1,1]“, 


and  the  unique  center  of  U(y)  is  the  zero  function.  Note  that  the  center  of 
U(y)  does  not  belong  to  U(y)  for  y f 0.  Furthermore,  every  function  a, 
a 6 3^,  which  agrees  with  f at  x , i.e.,  ct(x  ) * f(x  ) * y , i * 1,2,. ..,n. 


4.5 


and  ||  cr ||  * max  |f(x  )|  * J|  yjj^  ts  a spline.  Thus  if  f ker  31,  i.e.,  y ^ 0, 
ISiSn 

then  there  exist  infinitely  many  splines  and  of  course  SP(Tf)  =*  P(f)  * 

{h  € ker  31:  ||  h-f  ||  ^ ||  y 1(^3  is  not  a singleton  set. 

Consider  the  central  linear  algorithm  cp(y)  “0.  Of  course  dev(cp)  ■ 1. 
Since  cp(y)  = 0 is  not  interpolatory , cp  is  not  a spline  algorithm.  Furthermore 
it  can  be  shown  that  any  interpolatory  algorithm  cp  has  the  local  error 
e(®,y)  • 2 for  any  y 6 31(3Q)  , ||  y^  - 1,  and  dev(cp)  * 2.  B 

Remark  4.2 

Theorem  4.1  states  that  among  homogenous  algorithms  only  the  spline  algo- 
rithm has  finite  deviation.  This  provides  the  answer  to  question  (1.1). 

When  the  spline  algorithm  is  nonlinear  the  class  of  linear  algorithms  with 
finite  deviation  is  empty.  When  the  spline  algorithm  is  linear,  the  class  of 
linear  algorithms  with  finite  deviation  consists  of  exactly  one  element; 
namely  the  unique  linear  spline  algorithm.  H 

Therefore  it  is  important  to  know  when  a spline  algorithm  is  linear. 
Although  we  defined  a spline  algorithm  cp  only  for  y € 31(3q)  , it  is  obvious 
that  cp(y)  » Sa(y)  where  a(y)  is  a spline  interpolating  y for  y € Cn,  is  the 
needed  extension.  Assume  that  SP(Tf)  is  a singelton  set  for  f € Note 

that  the  set  P(z)  defined  by  (3.3)  is  homogenous.  Thus,  since  SP(z)  is  a 
singleton  set  for  any  z € T(3g),  'SP(z)  = {a(z) } is  also  singleton  for  any 
z 6 T(3j)  “ 3^*  Therefore  we  can  define  an  operator  R:  3^  “*32  such  that 

(4.4)  R(z)  ■ a(z) . 

The  spline  algorithm  can  be  represented  by  R as 

(4.5)  S<x(y)  - Sf  - R(Tf) , vy  = 31(f). 


JZLl. 


4.6 


Indeed,  since  a(y)  is  a spline  then  f - a(y)  6 P(Tf)  for  any  f such  that 
31(f)  ■ y.  Then  S(f-a(y))  € SP(Tf)  = [a(Tf)}  and  Sa(y)  = Sf  - S(f-o(y))  - 
Sf  - R(Tf ) which  proves  (4.5).  From  (4.5)  we  immediately  get 


Lemma  4 .4 

Let  SP(z)  be  a singleton  set  for  any  z € Then  the  spline  algorithm 

is  linear  iff  R is  a linear  operator.  □ 

Elsewhere  in  this  paper  we  give  examples  for  which  a linear  spline  algo- 
rithm exists.  We  now  illustrate  Lemma  4.4  by  an  example  of  a unique  spline 
algorithm  which  is  nonlinear. 


Example  4 .2 

Let  3X  = 
^ n.  Define 
is  given  by 


'h. 

II* 


= 3^  be  the  space  of  polynomials  of  one  variable  of  degree 

||  ■ max  |f(t)|  and  let  S ■ T * I.  The  information  operator 
Ostsi 


31(f) 


f (tl)  (0) 

’ nl 


]• 


Thus  h € ker  31  implies  h(t)  = const.  Then 


P(f)  = [h(t)  s h.  : sup  |f(t)-h  | - inf  sup  |f(t)-c|), 
Ost^i  u c€R  OSt^l 


i.e.,  h 6 P(f)  iff  h is  a constant  function  and  h is  the  best  approximation 
of  f among  all  zeroth  degree  polynomials.  It  is  well  known  that  P(f)  **  [a(f)} 
is  singleton  and 

R(f)  * a(f)  * (f+f)/2 

where  f * max  f(t)  and  f^  ■ min  f(t).  Of  course,  R is  nonlinear  which  means 
OSt^l  0«t«l 


A 


7 
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that  the  unique  spline  algorithm  is  also  nonlinear.  Define  g (y) 

From  (4.5)  we  get 


where  y, 
J 1 


il 


9 (y)  ■ So (y)  = f - R (f ) = g (y)  + f(0)  - (f+f)/2  - 
= g(y)  + f (0)  - (i+2f  (0)-£)  - g(y)  - (5+g)/ 2. 

It  can  be  shown  that  the  spline  algorithm  is  central  and 


e(cp  ,y)  ■ 1 - (I-£)/2  £ r(3l,s,T)  - 1. 


O 


<l*» 


5.1 


5.  SPLINE  ALGORITHMS  IN  A HILBERT  CASE 


In  this  section  we  assume  that  the  operator  T maps  onto  a Hilbert  space 
3^  " T(3^  and  T(ker  21)  is  closed.  Observe  that  the  set  SP(Tf)  is  singleton 
for  any  f 6 3^.  Indeed  let  o^y)  and  a^(y)  be  splines  which  interpolate 
y = 2t(f) . Then  Ta^y)  is  orthogonal  to  T(ker  21).  Let  h = a^y)  - a2(y). 

Then  h € ker  21  and  J|  T<7^  If  ■ II  to2  if  ' ||  TCTj-Th  |p  = llTajf  + HThlf.  This 
implies  that  Th  « 0.  Thus  h 6 ker  21  H ker  T and  (2.11)  yields  h € ker  S, 
i.e.,  Scr^y)  = Scr2(y) . 

The  unique  spline  algorithm  may  be  derived  as  follows.  Let 

e*  * [0, . . . ,1, . . . ,0]  6 Cn  denote  the  1th  unit  vector,  i«l,2,...,n.  Find 

a..  € 3t  such  that  21(c  ) = e1  and  To  is  orthogonal  to  T(ker  21).  of  course 
1 1 1 J.  1 f 

a±  is  a spline  interpolating  e . Then  c(y)  = £ Li(f)ai  is  also  orthogonal 

i«l 

to  T(ker  21)  and  therefore  o(y)  is  a spline  interpolating  y = [L^f)  ,L2  (f)  , . . . ,LQ(f)  ]. 

g 

The  unique  spline  algorithm  cp  is  of  the  form 


(5.1)  cp  (y)  =»  So (y)  * ^ Li(f)Soi 

i-1 

for  y * 31(f).  This  shows  that  the  spline  algorithm  is  linear. 


Theorem  5.1 


\ If  JJ,  is  a Hilbert  space  and  T(ker  91)  is  closed  then  the  spline  algorithm 

SN 

cp  'is  central  and 

(5.2)  e(cps,y)  - rad  U(y)  - Jl-  ||  Tc(y)  If2'  r(2l,s,T) 


where  the  radius  of  information  is  equal  to 


5.2 


(5.3)  r(3t,s,T) 


sup 

h€ker  31 


Sh 

Th 

Proof 

Let  f € V(y)  . Then  f ■ tf(y)  + h where  h 6 ker  31  and 
1 2 ||  Tf  |p  - ||  T«x(y)|f  + ||  Thlf.  Thus 

V(y)  * (a(y)  + h : h € ker  31  and  ||  Thlf  s 1 - ||  Ta(y)  |f]. 

We  now  show  that  U(y)  ■ SV(y)  is  symmetric  with  respect  to  So(y) • Indeed, 
let  Sa(y)  + Sh  € U(y) . Then  h € ker  31  and  ||  Th|f  si-  ||  To(y)  |f . The 
element  Sa( y)  - Sh  also  belongs  to  U(y)  since  3l(<j(y)-h)  = y and 
||  T(CT(y)-h)  |f  - ||  To(y)  |f  + ||  Th|f  s 1. 

From  this  it  easily  follows  that  a ■ Sc(y)  is  a center  of  U(y).  To  show 
this  assume  that  a is  not  a center,  i.e.,  there  exist  elements  b 6 U(y)  and 
s € such  that 

(5.4)  sup  ||  s-u||  < ||  b-a||  . 
uQJ(y) 

Since  U(y)  is  symmetric  with  respect  to  a and  a € U (y)  then  2a-b  also  belongs 
to  U(y)  and  (5.4)  yields  ))  s-(2a-b)||<  ||  b— a ||  . But 

2 ||  b-a ||  = ||  s-(2a-b)+b-s||  S ||  s-(2a-b)||+  ||  s-b  ||  < 2 ||  b-a  || 

which  is  a contradiction. 

Hence,  cpS  (y)  * So(y)  is  a central  algorithm  and 

e(<ps,y)  " rad  U(y)  - supCH  S(o(y)+h)-Sa(y)  ||  : cr(y)  + h € V(y)}  = 

- sup (||  Sh ||  : h € ker  31,  ||  Th||  s J\-  ||  Ta(y)  |f  ) = 

- Jl-  ||  Ta(y)  |f'  sup  (||  Sh||  / 1|  Th||  : h € ker  3l). 


Observe  that  r(31,S,T) 
proof. 


sup  rad  U(y)  = rad  U(0)  which  completes  the 

y©(V 

H 

Theorem  5.1  states  that  the  spline  algorithm  is  central.  It  is  also 
linear.  These  are  very  desirable  and  useful  properties.  This  affirmatively 
answers  our  questions  from  Section  1 for  any  linear  operators  S,  T and  31 
(assuming  that  ^ is  a Hilbert  space  and  T(ker  31)  is  closed).  We  illustrate 
Theorem  5.1  by  two  examples. 

Example  5.1 

Suppose  that  3^  “ 3^  a Hilbert  space  with  an  orthonoraal  basis 
^i^‘«l*  Let  T be  30  ort^°8OTia^  operator,  i.e.,  T T = TT  “I.  Let  f c 3^» 

i.e.,  f - / (f, ?.,)§.•  Define  the  information  operator  31  as 

£->  i i 

i-1 

y - 31(f)  - [(£,51),(f,S2),...,(f,5n)]. 
n 

Then  cr(y)  * ^ (f,!.)^  satisfies  3l(a(y))  = y and  for  any  h € ker  31  = 
i-1  n 

(h  : (h,5  ) - 0,  i-1,2 , . . . ,n}  we  get  (TW(y) ,Th)  = (a,h)  - £ (f,S1)(§t,h)  - 0. 

i-1 

This  shows  that  a truncated  Fourier  series  a( y)  is  a spline.  Thus  for  any 
linear  operator  S : 3^  ^ t*ie  SP*1-116  algorithm 

n 

«p(y)  * £ (£t51)s5i 

i-1 

is  central  and  r(31,S,T)  - j|  S |^er  ^ - sup[j|  Sh  ||  : h € ker  31  and  ||  h||  £ l}.  ■ 
Example  5.2 

k 2 

Let  3^  ” w * [0,1]  be  a Sobolev  space,  i.e.,  the  space  of  functions  for 

which  the  (k-l)-st  derivative  is  absolutely  continuous  and  the  k-th  deriva- 

2 k fk) 

tive  belongs  to  ^ = L [0,1].  Let  T “ D , i.e.,  Tf  - f , and 


(J-l) 

31(f)  » [f  (xx) f (x1) , . . . ,f  (xr) , . . . ,f  (xr)] 

for  distinct  x 6 [0,1]  and  max  j < k.  Then  the  cardinality  of  31  is  equal 
1 l^i^r  1 

to  n = jj+j2+» • •+Jr*  Assuming  that  n £ k,  it  is  well-known  that  the  spline 
a(y)  is  the  natural  spline  function  of  degree  2n-l  with  respect  to  the  knots 
xl’*2**’**Xr  with  j2»  • • •» Jr  respectively. 

Many  authors  dealt  with  this  information  operator  with  different 
^l,^2,*”,^r  ^°r  ^i^erent  linear  operators  S.  See  the  Introduction  for  the 

rl 

reference  list.  For  instance  if  S = I or  S(f)  = i f(x)dx  it  is  known  that 

-k 

r(3l,S,T)  * +®  for  n < k and  r(3l, S,T)  =*  0(n  ) for  n ^ k.  Theorem  5.1  states 

that  for  any  linear  operator  S the  algorithm  obtained  through  natural  spline 
is  central.  H 
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6.  SPLINE  ALGORITHMS  IN  A NON-HILBERT  CASE 


In  this  section  we  deal  with  spline  algorithms  where  ^ is  not  neces- 
sarily a Hilbert  space.  We  give  necessary  and  sufficient  conditions  on  a 
spline  algorithm  to  be  a central  or  optimal  algorithm.  We  also  show  examples 
for  which  spline  algorithms  are  neither  central  nor  optimal.  We  begin  with 
the  centrality  of  spline  algorithms.  It  is  intuitively  obvious  that  a spline 
algorithm  is  central  iff  the  centers  of  U(y)  belong  to  U(y)  and  enjoy  the 
same  homogenous  property.  A formal  proof  is  provided  by 

Lemma  6.1 

0 

There  exists  a central  spline  algorithm  cp  iff  there  exists  a function 
c : 91(3q)  “*  32  such  that 

(i)  c(y)  6 U(y)  and  c(y)  is  a center  of  U(y),  Vy  6 2I(3Q) , 

(ii)  c is  homogenous,  i.e.,  tc  (y)  GU(ty)  and  is  a center  of  U(ty), 

V 1 1 1 si,  Vy  € 3IC3q)  - 

Proof 

C 0 

Suppose  that  cp  is  a central  spline  algorithm.  Define  c(y)  ■ cp  (y)  = Sa(y). 
c 

Since  cp  is  interpolatory,  central  and  a( y)  is  homogenous  then  c has  the 
desired  properites. 

Assume  now  that  c satisfies  (i)  and  (ii)  which  means  c(y)  is  a homogenous 
algorithm  which  is  interpolatory.  From  Lemma  4.2  it  follows  that  c(y)  is  a 
spline  algorithm.  fl 

We  now  show  an  example  where  the  unique  linear  spline  algorithm  is 
optimal  but  not  central. 


6.3 


and  cpS  ^ ©C . D 

We  turn  to  the  question  when  a spline  algorithm  is  optimal.  Note  that 
we  now  deal  with  nonunique  spline  algorithms  since  we  do  not  assume  that 
SP(Tf)  is  a singleton  set. 

Lemma  6.2 

There  exists  an  optimal  spline  algorithm  iff  there  exists  a function 
a : 3t(3Q)  "*  ^2  SUch  that 

(i)  o(y)  is  a spline  interpolating  y,  Vy, 

(ii)  for  any  f € 3q,  y - 31(f), 

||  Tf-To(y)  [}  > 1 implies  ||  Sf-Sa(y)  ||  * r(3l,S,T).  ■ 

Proof 

•S  g mm 

Suppose  that  cp  is  an  optimal  spline  algorithm,  cp  (y)  * Scr(y)  , where 
a(y)  is  a spline  interpolating  y.  Then  ||  Sf-So(y)  ||  s r(3l,S,T)  for  any 
f 6 3q,  y * 31(f).  Hence  we  can  put  o(y)  = a(y)  which  satisfies  (i)  and  (ii). 

Assume  now  that  a satisfies  the  conditions  (i)  and  (ii) . Define  an 
algorithm  cp(y)  * Sa(y)  . Due  to  (i) , cp  is  a spline  algorithm.  Consider 
||  Sf-cp(y)  |J  for  y - 31(f).  If  ||  Tf-Ta(y)  J|  > 1 then  'ii)  implies 
||  Sf-cp(y)  ||  s r(3t,S,T).  If  ||  Tf-Ta(y)  ||  £ 1 then  setting  h = f - a(y) , 
h € ker  31,  we  have  ||  Sf-cp(y)  ||  - ||  Sh||  and  ||  Th||  * 1.  Thus  ||  Sf-tp(y)  ||  £ 
s ||  sh ||  /||  Th  ||  £ r(3l,S,T),  due  to  (2.10).  This  means  that  cp  is  an  optimal 
spline  algorithm  which  completes  the  proof.  B 

Lemma  6.2  states  that  a spline  algorithm  cpS(y)  ■ Sa(y)  is  optimal  if 
the  elements  h " f - a(y)  of  the  large  T-norm,  ||  Th  ||  > 1,  are  correlated  with 
the  operator  S in  such  a way  that  ||  Sh||  is  small,  i.e.,  ||  Sh  ||  £ r(3l,s,T). 


Y 

[ 


Note  that  if  is  a Hilbert  space  we  have  a unique  spline  algorithm  for 
which  ||  Th||  ■ J\\  Tf  ||^~  ||  To(y)  |p  £ ||  Tf  ||  £ 1 and  condition  (ii)  is  automatically 
satisfied.  Note  that  Lemma  6.2  provides  the  answer  to  question  (1.2).  Namely, 
the  class  of  linear  algorithms  with  finite  deviation  which  are  optimal  is 
nonempty  iff  there  exists  a function  a satisfying  (i)  and  (ii)  of  Lemma  6.1. 

Example  6.1  provides  a problem  in  a non-Hilbert  space  ^ for  which  con- 
dition (ii)  holds.  We  now  consider  an  example  for  which  an  unique  spline  algo- 
rithm is  not  optimal  and  its  deviation  is  arbitrary  close  to  two. 

Example  6,2 

Let  ^ ^ » R2  - £ (f ^ , f 2)  : f^  are  real}  with  the  l2-norm  j|  f||  * v42+f2 . 

2 1 
Let  2^  - R be  equipped  with  the  norm  ||  f ||  = max(  | f ^ | ,—  | | ) where  a parameter 

a € (1,+®).  Define  Sf  ■ f,  Tf  ■ f and  31(f)  * f^+f2»  Thus  knowing  the  sum 

of  components  of  f we  want  to  recover  f where  f 6 3q  * [f  : ||  Tf  j|  ■ 

- max ( | f 1 1 »“ | f 2 | ) s I}* 

Figure  6.2  shows  the  central  and  spline  algorithms.  The  central  algo- 

c 

rithm  cp  is  equal  to 


(y+l-a»  for  a-1  £ y £ a+1, 

coC(y)  ■ \ (0,y)  for  |y | £ a-l, 

(y~2+,a»  y+,|~a)  for  1-a  ^ y £ -a+1. 


e(cp  ,y)  - 


V2  for  I y I ^ a-l 

rr 

~(l+a-|y|)  otherwise. 


Hence  r(3l,S,T)  ■ Jl.  The  unique  spline  algorithm  q>S  is  given  by 


9 (y)  ■ y 


*)  • 
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Fig.  6.2 


g 

The  local  error  of  cp  is 

fjl 

e(cpS,y)  - 

and  e(cpS)  * e(cpS,a-l)  * a 


(y+a+1)  for  |y|  £ a-1, 

a(l+a-|y|)  otherwise, 

31  -|^a  r(9l,S,T).  This  means 


s 

that  cp 


is  not 


optimal . Furthermore 


6.6 


§ 

dev(cp  ) 


e (cpS  ,a- 1)  = 2a 

rad  U(a-l)  1+a' 


g 

Thus  for  large  a,  dev(cp  ) can  be  arbitrary  close  to  2. 

We  want  also  to  stress  that  for  this  problem  there  exists  a unique 
optimal  linear  algorithm  cp^,  cp^1  (y)  =*  (0,y) , which  is  not  an  interpolatory 
algorithm  and  whose  deviation  is  infinity. 


• - — 


■■■■■■ 


We  briefly  note  that  there  is  a relationship  between  the  concept  of 

the  radius  of  information  and  the  Kolmogorov  n-width.  For  the  definition  of 

Kolmogorov  n-width  see,  for  instance,  Lorentz  [66].  Namely,  suppose  tnere  exists 

a linear  optimal  error  algorithm  <p.  Thus  Sf,  for  any  f € 3 , is  approximated  by 
n 

an  element  cp(y)  = ^ Li(f)gi  € G = lin(g1>g2 ,•••  ,gn>  • Note  that  dim  G * n and 
i-1 

(7.1)  r(9t,S,T)  = e(cp)  =*  sup  inf  ||  Sf-g||  ^ 

f630  g& 

2 inf  sup  inf  ||  Sf-g  ||  * d (5(30  ,3-) 

G f€3p  g^G 
GC[^  ,dimG^i 


where  dn(S(3Q),32)  is  the  Kolmogorov  n-width  of  the  set  S(3q)  in  the  space  3^ 
Furthermore  if  3^  is  a Hilbert  space  then  it  can  be  shown  that 

inf  r(3l,S,T)  - d (S(30),32) 

31  n u z 

card  (31) 


which  means  that  for  a suitably  chosen  information  operator  the  radius  is 
equal  to  the  Kolmogorov  n-widths.  These  and  other  relations  with  the  Gelfand 
and  linear  Kolmogorov  n-widths  and  entropy  for  linear  problems  in  general 
linear  spaces  will  be  reported  in  a research  monograph  (Traub  and  Wozniakowski 

[79]). 


8.1 


8.  SUMMARY 

We  summarize  Che  results  of  Che  paper.  Assuming  Che  uniqueness  of 
§ 

the  spline  algorithm  9 , the  answer  to  question  (1.1)  is  that  the  class  of 

g 

linear  algorithms  with  finite  deviation  is  empty  if  9 is  nonlinear.  This 

s s 

class  consists  of  one  element,  namely  9 , if  9 is  linear.  The  answer  to 

question  (1.2)  is  that  the  class  of  linear  algorithms  with  finite  deviation 

s 

which  are  optimal  is  empty  if  9 is  nonlinear  or  nonoptimal.  This  class 

s s 

consists  of  one  element, . namely  9 , if  9 is  linear  and  optimal.  We  give 

5 

necessary  and  sufficiently  conditions  for  9 to  be  linear,  central,  and 
optimal. 

If  T(ker  !Jt)  is  closed  in  a Hilbert  space,  there  exists  a unique  spline 

g 

algorithm  9 which  is  central  and  linear.  Due  to  centrality  it  yields  the 
aest  possible  approximation  for  every  f.  Due  to  linearity,  its  combinatory 
complexity  is  small  since  the  idea  of  precomputing  can  be  used.  We  stress 
again  that  in  general  the  combinatory  complexity  of  a nonlinear  spline  algo- 
rithm is  high  and  that  precomputing  cannot  be  used. 
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